Interface system for flight deck communications

ABSTRACT

An interface system for flight deck communications includes a chatbot configured to perform a conversation with a pilot. The conversation includes speech communications, visual communications using a display, or both. The interface system also includes a dynamic conversational graph generator. The dynamic conversational graph generator is configured to perform a set of functions including determining a flight operational procedure from the conversation with the pilot. The set of functions also include providing information associated with the flight operational procedure to the chatbot for communicating to the pilot. The set of functions also include responding to any requests received from the pilot by the chatbot during the conversation with the pilot.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the benefit of priority of U.S. ProvisionalApplication No. 63/166,511, filed Mar. 26, 2021, which is incorporatedherein by reference in its entirety.

FIELD

The present disclosure relates to aircraft and other vehicles and moreparticularly to an interface system for flight deck communications.

BACKGROUND

During operation of an aircraft, flight crews need to interface with thedifferent systems of the aircraft, monitor equipment onboard theaircraft, access information, communicate with air traffic controllers,and respond to different events during all phases of a flight amongother tasks involved in flying an airplane. Accessing information,monitoring equipment, and responding to certain occurrences, along withactually flying the airplane, can be hectic at times, particularlyduring high workload situations for the crew. Accordingly, there is aneed for systems that reduce pilot workload, improve situationalawareness, and allow the crew to focus on actual operation andnavigation of the aircraft.

SUMMARY

In accordance with an example, an interface system for flight deckcommunications includes a chatbot configured to perform a conversationwith a pilot. The conversation includes speech communications, visualcommunications using a display, or both. The interface system alsoincludes a dynamic conversational graph generator configured to performa set of functions. The set of functions includes determining a flightoperational procedure from the conversation with the pilot; providinginformation associated with the flight operational procedure to thechatbot for communicating to the pilot; and responding to any requestsreceived from the pilot by the chatbot during the conversation with thepilot.

In accordance with another example, a method for flight deckcommunications includes performing, by a chatbot, a conversation with apilot, wherein the conversation includes speech communications, visualcommunications using a display, or both. The method also includesdetermining, by a dynamic conversational graph generator, a flightoperational procedure from the conversation with the pilot. The methodadditionally includes providing, by the dynamic conversational graphgenerator, information associated with the flight operational procedureto the chatbot for communicating to the pilot. The method furtherincludes responding, by the dynamic conversational graph generator, toany requests from the pilot received by the chatbot during theconversation with the pilot.

In accordance with an example and any of the preceding examples, theinterface system and method further include a tokenizer. The tokenizeris configured to: convert text received from the chatbot to tokenstransmitted by the tokenizer; and convert tokens received by thetokenizer to text that is transmitted to the chatbot to perform theconversation with the pilot.

In accordance with an example and any of the preceding examples, the setof functions performed by the dynamic conversational graph generatorfurther includes: detecting a keyword in the conversation with the pilotusing the tokens from the tokenizer, wherein the keyword identifies aparticular flight operational procedure; searching a plurality of nodesof a dynamic conversational graph to identify a node corresponding tothe keyword in the conversation with the pilot, wherein each nodecorresponds to a different flight operational procedure; handing-offcommunications to a system directed conversation module in response tothe node corresponding to the keyword having an owner, wherein the owneris a particular aircraft system associated with the flight operationalprocedure; and determining an identification of any neighboring nodes inthe dynamic conversational graph to the node corresponding to thekeyword in response to the node not having an owner, wherein theidentification of any neighboring nodes are communicated to the pilot bythe chatbot in the conversation.

In accordance with an example and any of the preceding examples, theinterface system and the method further include a system directedconversation module configured to provide certain tokens includingparticular information associated with the flight operational procedureto the tokenizer in response to the flight operational procedure beingassociated with a particular aircraft system of a plurality of aircraftsystems. The dynamic conversational graph generator is configured tohandoff communications to the system directed conversation module inresponse to the flight operational procedure being associated with theparticular aircraft system.

In accordance with an example and any of the preceding examples, theinterface system and the method further include a commandencoder/decoder configured to: receive and execute formattedinstructions related to the flight operational procedure from the systemdirected conversation module for communications with the particularaircraft system of the plurality of aircraft systems; and decode theparticular information from the particular aircraft system into a set ofresponses for communications with the system directed conversationmodule.

In accordance with an example and any of the preceding examples, theinterface system and method further include a dynamic widget/formgenerator configured to perform a set of functions including: receivingthe tokens from the tokenizer, or a controller-pilot data linkcommunications (CPDLC)/Aircraft Communication Addressing and ReportingSystem (ACARS) text analyzer that receives text; and generating aparticular form, widget or both in response to the tokens.

In accordance with an example and any of the preceding examples, theinterface system and method further include a dynamic widget/formgenerator configured to generate a particular form, widget or bothassociated with the flight operational procedure for presentation in awindow on a display. The particular form, widget or both are configuredfor interaction with the pilot.

In accordance with an example and any of the preceding examples, theinterface system and method, wherein a visual positioning or alignmentof the particular form, widget or both associated with the flightoperational procedure is correlated to a corresponding visual chatbotconversational text.

In accordance with an example and any of the preceding examples, theinterface system and method, wherein pilot interaction with theparticular form, widget or both includes at least one of interaction byconversing with the chatbot or interaction by the pilot touching afeature of the particular form, widget, or both.

In accordance with an example and any of the preceding examples, theinterface system and method further include an automatic speechrecognition device configured to receive speech from the pilot and toconvert the speech to text for transmission to the chatbot. Theinterface system and method additionally include a text-to-speechconverter configured to receive text from the chatbot and to convert thetext to speech for transmission to the pilot by a speaker, wherein thespeaker is in a flight deck or a headset of the pilot.

In accordance with an example and any of the preceding examples, theinterface system or method wherein the chatbot is configured to performthe conversation with the pilot using at least one of an audio panel ina flight deck, a cockpit display in the flight deck, or a portableelectronic device.

The features, functions, and advantages that have been discussed can beachieved independently in various examples or may be combined in yetother examples further details of which can be seen with reference tothe following description and drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIGS. 1 and 2 are a block schematic diagram of an example of aninterface system for flight deck communications in accordance with anexample of the present disclosure.

FIG. 3 is a flow chart of an example of a method of operation of adynamic conversational graph generator in accordance with an example ofthe present disclosure.

FIG. 4A is a flow chart of an example of a method of operation of asystem directed conversation module in accordance with an example of thepresent disclosure.

FIG. 4B is an illustration of an example of a database for use by thesystem directed conversation module in accordance with an example of thepresent disclosure.

FIGS. 5A-5C are a flow chart of an example of a method of operation ofthe interface system in FIG. 1 and FIG. 2 in accordance with an exampleof the present disclosure.

FIGS. 6A-6B are a table illustrating an example of performance of aconversation with a pilot in accordance with an example of the presentdisclosure.

FIG. 7 is an example of a dynamic conversational graph in accordancewith an example of the present disclosure.

FIG. 8 is a flow chart of an example of a method of operation of adynamic widget/form generator in accordance with an example of thepresent disclosure.

FIGS. 9A-9B are examples of chatbot windows and pilot interactionwindows generated by a dynamic widget/form generator during aconversation in accordance with an example of the present disclosure.

FIG. 10 is a flow chart of an example of a method for generating ahistorical/trained conversation database in accordance with an exampleof the present disclosure.

FIG. 11 is a flow chart of an example of a method for flight deckcommunications in accordance with an example of the present disclosure.

FIG. 12 is an example of a system for flight deck communications inaccordance with an example of the present disclosure.

DETAILED DESCRIPTION

The following detailed description of examples refers to theaccompanying drawings, which illustrate specific examples of thedisclosure. Other examples having different structures and operations donot depart from the scope of the present disclosure. Like referencenumerals may refer to the same element or component in the differentdrawings.

The present disclosure may be a system, a method, and/or a computerprogram product. The computer program product may include acomputer-readable storage medium (or media) having computer-readableprogram instructions thereon for causing a processor to carry outaspects of the present disclosure.

The computer-readable storage medium can be a tangible device that canretain and store instructions for use by an instruction executiondevice. The computer-readable storage medium may be, for example, but isnot limited to, an electronic storage device, a magnetic storage device,an optical storage device, an electromagnetic storage device, asemiconductor storage device, or any suitable combination of theforegoing. A non-exhaustive list of more specific examples of thecomputer-readable storage medium includes the following: a portablecomputer diskette, a hard disk, a random access memory (RAM), aread-only memory (ROM), an erasable programmable read-only memory (EPROMor Flash memory), a static random access memory (SRAM), a portablecompact disc read-only memory (CD-ROM), a digital versatile disk (DVD),a memory stick, a floppy disk, a mechanically encoded device such aspunch-cards or raised structures in a groove having instructionsrecorded thereon, and any suitable combination of the foregoing. Acomputer-readable storage medium, as used herein, is not to be construedas being transitory signals per se, such as radio waves or other freelypropagating electromagnetic waves, electromagnetic waves propagatingthrough a waveguide or other transmission media (e.g., light pulsespassing through a fiber-optic cable), or electrical signals transmittedthrough a wire.

Computer-readable program instructions described herein can bedownloaded to respective computing/processing devices from acomputer-readable storage medium or to an external computer or externalstorage device via a network, for example, the Internet, a local areanetwork, a wide area network and/or a wireless network. The network maycomprise copper transmission cables, optical transmission fibers,wireless transmission, routers, firewalls, switches, gateway computersand/or edge servers. A network adapter card or network interface in eachcomputing/processing device receives computer-readable programinstructions from the network and forwards the computer-readable programinstructions for storage in a computer-readable storage medium withinthe respective computing/processing device.

Computer-readable program instructions for carrying out operations ofthe present disclosure may be assembler instructions,instruction-set-architecture (ISA) instructions, machine instructions,machine dependent instructions, microcode, firmware instructions,state-setting data, or either source code or object code written in anycombination of one or more programming languages, including an objectoriented programming language such as Smalltalk, C++ or the like, andconventional procedural programming languages, such as the “C”programming language or similar programming languages. Thecomputer-readable program instructions may execute entirely on theuser's computer, partly on the user's computer, as a stand-alonesoftware package, partly on the user's computer and partly on a remotecomputer or entirely on the remote computer or server. In the latterscenario, the remote computer may be connected to the user's computerthrough any type of network, including a local area network (LAN) or awide area network (WAN), or the connection may be made to an externalcomputer (for example, through the Internet using an Internet ServiceProvider). In some examples, electronic circuitry including, forexample, programmable logic circuitry, field-programmable gate arrays(FPGA), or programmable logic arrays (PLA) may execute thecomputer-readable program instructions by utilizing state information ofthe computer-readable program instructions to personalize the electroniccircuitry, in order to perform aspects of the present disclosure.

Aspects of the present disclosure are described herein with reference toflowchart illustrations and/or block diagrams of methods, apparatus(systems), and computer program products according to examples of thedisclosure. It will be understood that each block of the flowchartillustrations and/or block diagrams, and combinations of blocks in theflowchart illustrations and/or block diagrams, can be implemented bycomputer-readable program instructions.

These computer-readable program instructions may be provided to aprocessor of a general purpose computer, special purpose computer, orother programmable data processing apparatus to produce a machine, suchthat the instructions, which execute via the processor of the computeror other programmable data processing apparatus, create means forimplementing the functions/acts specified in the flowchart and/or blockdiagram block or blocks. These computer-readable program instructionsmay also be stored in a computer-readable storage medium that can directa computer, a programmable data processing apparatus, and/or otherdevices to function in a particular manner, such that thecomputer-readable storage medium having instructions stored thereincomprises an article of manufacture including instructions whichimplement aspects of the function/act specified in the flowchart and/orblock diagram block or blocks.

The computer-readable program instructions may also be loaded onto acomputer, other programmable data processing apparatus, or other deviceto cause a series of operational steps to be performed on the computer,other programmable apparatus or other device to produce a computerimplemented process, such that the instructions which execute on thecomputer, other programmable apparatus, or other device implement thefunctions/acts specified in the flowchart and/or block diagram block orblocks.

In accordance with some examples of the present disclosure, an interfacesystem for flight deck communications includes a chatbot configured toperform a conversation with a pilot. The conversation includes speechcommunications or audio communications, visual communications using adisplay or interactive touchscreen, or both. The interface systemincludes a dynamic conversational graph generator configured to performa set of functions. The set of functions includes but is not limited todetermining a flight operational procedure from the conversation withthe pilot; providing information associated with the flight operationalprocedure to the chatbot for communicating to the pilot; and respondingto any requests received from the pilot by the chatbot during theconversation with the pilot. In some examples, the interface system alsoincludes a tokenizer configured to convert text received from thechatbot to tokens which are transmitted by the tokenizer and to converttokens received by the tokenizer to text that is transmitted to thechatbot to perform the conversation with the pilot.

In some examples, the interface system also includes a system directedconversation module configured to direct the conversation with the pilotto a particular aircraft system associated with the flight operationalprocedure. The dynamic conversational graph generator is configured tohandoff communications to the system directed conversation module inresponse to the flight operational procedure being associated with theparticular aircraft system of a plurality of aircraft systems.

In some examples, the interface system also includes a dynamicwidget/form generator configured to generate a particular form, widgetor both associated with the flight operational procedure forpresentation in a window on a display. The particular form, widget orboth are configured for interaction with the pilot. Pilot interactionwith the particular form, widget or both includes but is not limited toat least one of interaction by conversing with the chatbot orinteraction by the pilot touching a feature of the particular form,widget, or both on a display. Examples of the display include but arenot limited to a touchscreen cockpit display in the flight deck or adisplay of a portable electronic device. Accordingly, the examples ofinterface systems for flight deck communications described herein reducepilot workload, improve situational awareness, and allow the crew tofocus on actual operation and navigation of the aircraft.

FIGS. 1 and 2 are a block schematic diagram of an example of aninterface system 100 for flight deck communications in accordance withan example of the present disclosure. The interface system 100 includesa chatbot 102 configured to perform a conversation with a pilot 103. Theconversation includes speech or audio communications, visualcommunications using a display, or both. An example of performance of aconversation 602 between the chatbot 102 and a pilot 103 will bedescribed with reference to FIGS. 6A-6B. The chatbot 102 is configuredto perform the conversation 602 with the pilot 103 using at least one ofan audio panel 104 in a flight deck 105, a cockpit display 106 in theflight deck 105, or a portable electronic device 108, such as a tabletcomputer, electronic flight bag (EFB) or similar device. The audio panel104 includes a microphone 110 to receive speech or audio signals fromthe pilot 103 and a speaker 112 to transmit speech or audio signals tothe pilot 103. In some examples, the cockpit display 106 includes atouchscreen 114 configured to receive inputs by the pilot 103 touchingthe cockpit display 106 as described herein. The portable electronicdevice 108 also includes a touchscreen 116 configured to receive inputsby touch.

In the examples in FIGS. 1 and 2, a display computer 118 interconnectsthe chatbot 102 to the cockpit display 106. The display computer 118 isconfigured to convert text signals from the chatbot 102 to video signalsfor presentation on the cockpit display 106 and to convert input signalsentered by the pilot 103 into the touchscreen 114 into text signals thatare usable by the chatbot 102.

In the examples in FIGS. 1 and 2, an aircraft interface device 120interconnects the chatbot 102 to the portable electronic device 108. Theaircraft interface device 120 is configured to convert text signals fromthe chatbot 102 to video signals for presentation on the portableelectronic device 108 and to convert input signals entered by the pilotinto the touchscreen 116 into text signals that are usable by thechatbot 102.

The interface system 100 also includes an automatic speech recognition(ASR) device 122 configured to receive speech from the pilot 103 by themicrophone 110 and to covert the speech to text for transmission to thechatbot 102. The interface system 100 additionally includes atext-to-speech (TTS) converter 124 configured to receive text from thechatbot 102 and to convert the text to speech or audio for transmissionto the pilot 103 by the speaker 112. The speaker 112 is in the flightdeck 105 or a headset of the pilot 103.

The interface system 100 further includes a tokenizer 126 configured toconvert text received from the chatbot 102 to tokens transmitted by thetokenizer 126 and to convert tokens received by the tokenizer 126 totext that is transmitted to the chatbot 102 to perform the conversation602 with the pilot 103. The tokenizer 126 breaks-up sentences or asequence of words or phrases spoken by the pilot 103 into pieces, suchas words, keywords, phrases, symbols or other elements called tokens.Tokens can be individual words, phrases or a whole sentence.

The interface system 100 also includes a dynamic conversational graphgenerator 128 configured to perform a set of functions 130. Referringalso to FIG. 3, FIG. 3 is a flow chart of an example of a method 300 ofoperation of the dynamic conversational graph generator 128 inaccordance with an example of the present disclosure. The exemplarymethod 300 includes an example of the set of functions 130. The method300 or set of functions 130 includes but is not limited to: receiving,in block 304, one or more tokens 302 corresponding to the conversation602 with the pilot 103 from the tokenizer 126; determining, in block306, a flight operational procedure from the tokens 302 corresponding tothe conversation 602 with the pilot 103; providing, in block 308,information associated with the flight operational procedure to thechatbot 102 for communicating to the pilot 103; and responding, in block310, to any requests received from the pilot 103 by the chatbot 102during the conversation 602 with the pilot 103. Examples of additionalfunctions of the set of functions 130 performed by the dynamicconversational graph generator 128 will be described with referenceFIGS. 5A-5C and FIGS. 6A-6B.

The dynamic conversational graph generator 128 accesses ahistorical/trained conversation database 132 to perform the set offunctions 130. An example of a method 1000 for generating ahistorical/trained conversation database 132 will be described withreference to FIG. 10. The historical/trained conversation database 132includes historical information and/or is trained to form dynamicconversational graphs for performing a conversation with the pilot 103,e.g., exemplary conversation 602 (FIGS. 6A-6B). An example of a dynamicconversational graph 700 is illustrated in FIG. 7 and is useable forperformance of a conversation, such as the exemplary conversation 602 inFIGS. 6A-6B.

The interface system 100 further includes a system directed conversationmodule 134 configured to direct the conversation with the pilot 103 to aparticular aircraft system 136 associated with the flight operationalprocedure. As used herein, an aircraft system 136 also includes asubsystem of an aircraft system 136. The system directed conversationmodule 134 is configured to provide certain tokens including particularinformation associated with the flight operational procedure to thetokenizer 126 in response to the flight operational procedure beingassociated with a particular aircraft system 136 of a plurality ofaircraft systems 136 a-136 n. The dynamic conversational graph generator128 is configured to handoff communications to the system directedconversation module 134 in response to the flight operational procedurebeing associated with the particular aircraft system 136. Examples ofthe aircraft systems 136 a-136 n include but are not limited to a flightmanagement system (FMS) 136 a, a flight computer (FC) 136 b, electronicchecklists 136 c performed by a display system, a health managementsystem 136 d, and other airborne systems 136 n or subsystems.

The system directed conversation module 134 is configured to perform aset of functions 138. Referring also to FIG. 4A, FIG. 4A is a flow chartof an example of a method 400 of operation of a system directedconversation module 134 in accordance with an example of the presentdisclosure. The exemplary method 400 includes an example of the set offunctions 138. The method 400 or set of functions 138 includes but isnot limited to the functions described with reference to blocks 402-416.In block 402, the method 400 or set of functions 138 includes receivingone or more tokens 403 from the tokenizer 126. The tokens 403 includeinformation associated with the flight operational procedure.

In block 404, the method or set of functions 138 includes querying adatabase 140 related to the flight operational procedure by the systemdirected conversation module 134 using the tokens 403. An example of adatabase 140 for use by the system directed conversation module 134 willbe described with reference to FIG. 4B.

In block 406, the method 400 or set of functions 138 includesdetermining the particular aircraft system 136 of the plurality ofaircraft systems 136 a-136 n for performing the flight operationalprocedure.

In block 408, the method 400 or set of functions 138 includes executinga sequence of steps 410 (FIG. 4B) associated with the flight operationalprocedure and fetching a set of commands 412 that describes the flightoperational procedure stored in the database 140.

In block 414, the method 400 or set of functions 138 includescommunicating the commands 412 by the system directed conversationmodule 134 to the command encoder/decoder 142 for communication with theparticular aircraft system 136. The particular aircraft system 136 isconfigured to perform the commands 412 and return information related tothe flight operational procedure similar to that described withreference to the examples in FIGS. 6A-6B and FIGS. 9A-9B.

In block 416, the method 400 or set of functions 138 include receivinginformation related to the flight operational procedure by the systemdirected conversation module 134 from the particular aircraft system viathe command encoder/decoder 142.

In block 418, the method 400 or set of functions 138 includescommunicating information related to the flight operational procedure bythe system directed conversation module 123 to the pilot 103 through thetokenizer 126 and the chatbot 102.

In some examples, the database 140 includes one or more subsystemspecific speech/TTS databases 140 a-140 n. The database 140 is createdfor the desired flight operational procedures and is field loadable.Referring also to FIG. 4B, FIG. 4B is an illustration of an example of adatabase 140 for use by the system directed conversation module 134 inaccordance with an example of the present disclosure. The exemplarydatabase 140 illustrated in FIG. 4B includes an example of a sequence ofsteps 410 for presenting an approach checklist 419 by an electronicchecklist 136 c on a display system 420, e.g., the cockpit display 106,portable electronic device 108, or both. The database 140 is used by thesystem directed conversation module 134 in translation of tokens 403into the sequence of steps 410 which contains mnemonics/opcode andoperands/formatted instructions 422 which the command encoder/decoder142 is configured to interpret. The response from the commandencoder/decoder 142 is used by the system directed conversation module134 to fetch the tokens from the database 140 and forward the tokens tothe tokenizer 126 for communication in the conversation 602 with thepilot 103.

Referring back to FIGS. 1 and 2, the interface system 100 furtherincludes a command encoder/decoder 142. The command encoder/decoder 142is configured to receive and execute the mnemonics/opcode andoperands/formatted instructions from the system directed conversationmodule 134. Thereby, the command encoder/decoder 142 encodes andcommunicates avionics data with the particular aircraft system 136 ofthe plurality of the systems 136 a-136 n, as illustrated in FIGS. 1 and2. The command encoder/decoder 142 is also configured to decode theparticular information from the particular aircraft system 136 of theplurality of aircraft systems 136 a-136 n into a set of responses forcommunication with the system directed conversation module 134 andexecution of the set of functions 138.

Referring to FIG. 2, the interface system 100 further includes a dynamicwidget/form generator 144 configured to generate a particular form,widget or both associated with the flight operational procedure forpresentation in a window of a display, e.g., the cockpit display 106,display of the portable electronic device 108, or both. The dynamicwidget/form generator 144 uses a keyword/phrase to dynamic forms/widgetsdatabase 146 to generate the particular form, widget or both. An exampleof a method 800 of operation of the dynamic widget/form generator 144and using the keyword/phrase to dynamic forms/widgets database 146 togenerate a particular form, widget or both will be described withreference to FIG. 8 and FIGS. 9A and 9B. The particular form, widget orboth are configured for interaction with the pilot 103. As shown in theexample in FIG. 2, the dynamic widget/form generator 144 is coupled tocockpit display 106 by the display computer 118. The cockpit display 106is also coupled to the chatbot 102 as previously described and shown inFIG. 1 The display computer 118 is configured to convert signals fromthe dynamic widget/form generator 144 to video signals for presentationon the cockpit display 106 and to convert input signals entered by thepilot 103 into the touchscreen 114 into signals that are usable by thedynamic widget/form generator 144 for communication with a particularaircraft system 136, using the tokenizer 126, system directedconversation module 134 and command encoder/decoder 142.

The dynamic widget/form generator 144 is coupled to the portableelectronic device 108 by the aircraft interface device 120. The portableelectronic device 108 is also coupled to the chatbot 102 as previouslydescribed and shown in FIG. 1. The aircraft interface device 120 isconfigured to convert signals from the dynamic widget/form generator 144to video signals for presentation on the portable electronic device 108and to convert input signals entered by the pilot 103 into thetouchscreen 116 into signals that are usable by the dynamic widget/formgenerator 144 for communication with a particular aircraft system 136using the tokenizer 126, system directed conversation module 134 andcommand encoder/decoder 142.

In some examples, the dynamic widget/form generator 144 is configured toperform a set of functions 148 including but not limited to receivingtokens 149 from the tokenizer 126, or receiving tokens 152 from a datalink/controller-pilot data link communications (DL/CPDLC)/AircraftCommunications Addressing and Reporting System (ACARS) text analyzer 150that receives text 156; and generating a particular form, widget or bothin response to the tokens 149 or 152. The DL/CPDLC/ACARS text analyzer150 receives the text 156 from a ground station or other source.

An example of a method 800 of operation of the dynamic widget/formgenerator 144 will be described with reference to FIG. 8. Examples of aform, widget or both presented in a window 904 a-904 d of a display 900are illustrated in FIGS. 9A-9B and will be described with reference toFIGS. 9A-9B. A visual positioning or alignment of a particular form,widget or both associated with a flight operational procedure iscorrelated to a corresponding visual chatbot conversational text 905 asillustrated in FIGS. 9A-9B. The pilot interaction with the particularform, widget or both includes at least one of interaction by conversingwith the chatbot 102 or interaction by the pilot 103 touching a featureof the particular form, widget, or both, on a touchscreen 114 or 116 asdescribed with reference to FIG. 8 and FIGS. 9A-9B.

FIGS. 5A-5C are a flow chart of an example of a method 500 of operationof the interface system 100 in FIGS. 1 and 2 in accordance with anexample of the present disclosure. The flow chart is divided intofunctions or operations that are performable by the different componentsin FIGS. 1 and 2. In some examples, the set of functions 130 performableby the dynamic conversational graph generator 128 and the set offunctions 138 performable by the system directed conversation module 134are embodied in the method 500. In block 502, the method 500 includesreceiving text by a display. In accordance with some examples, the textis received by the touchscreen 114 of the cockpit display 106 or thetouchscreen 116 of the display of the portable electronic device 108entered by the pilot 103 as previously described.

In addition, or alternatively to receiving text by the display, in block504, the method 500 includes receiving speech from the pilot 103. Insome examples, in block 506, the method 500 includes presenting text ofthe speech on the display.

In block 508, the method 500 includes receiving the text by the chatbot102. In block 510, the method 500 includes converting the text to tokensby the tokenizer 126.

In accordance with some examples, the set of functions 130 performableby the dynamic conversational graph generator 128 includes blocks512-526 and blocks 548-560 in FIG. 5B. In block 512, the method 500 orset of functions 130 includes receiving the tokens by the dynamicconversational graph generator 128.

Referring also to FIGS. 6A-6B, FIGS. 6A-6B are a table 600 illustratingan example of performance of a conversation 602 with a pilot 103 inaccordance with an example of the present disclosure. In block 514 (FIG.5A), the method 500 or set of functions 130 performed by the dynamicconversational graph generator 128 includes detecting a keyword 604(FIG. 6A) or keywords in the conversation 602 with the pilot 103 usingthe tokens from the tokenizer 126. The keyword 604 identifies aparticular flight operational procedure. In the example in FIG. 6A, thekeyword 604 or keywords are “Approach Phase” which identifies theparticular flight operational procedure.

Referring also to FIG. 7, FIG. 7 is an example of a dynamicconversational graph 700 in accordance with an example of the presentdisclosure. In block 516, the method 500 or set of functions 130additionally includes searching a plurality of nodes 702-706 (FIG. 7) ofa dynamic conversational graph 700 to identify a node 702 correspondingto the keyword 604 (FIG. 6A) in the conversation 602 with the pilot 103.Each node 702-706 of the dynamic conversational graph 700 corresponds toa different flight operational procedure. In the example in FIGS. 6A-6Band FIG. 7, the keyword 604 “Approach Phase” corresponds to the flightoperational procedure node 702 in FIG. 7.

In block 518, the method 500 or set of functions 130 performed by thedynamic conversational graph generator 128 further includes determiningif the node 702 corresponding to the flight operational procedure has anowner or particular aircraft system 136 for performing the flightoperational procedure.

In block 520, the method 500 or set of functions 130 performed by thedynamic conversational graph generator 128 additionally includeshanding-off (block 522) communications to the system directedconversation module 134 in response to the node 702 corresponding to thekeyword 604 having an owner. The owner is a particular aircraft system136 associated with the flight operational procedure or particularaircraft system 136 that performs the flight operational procedure. Themethod 500 or set of functions 130 advances to block 524 in response tothe node 702 corresponding to the keyword 604 not having an owner.

In block 524, the method 500 or set of functions 130 performed by thedynamic conversational graph generator 128 further includes determiningan identification of any neighboring nodes 704 in the dynamicconversational graph 700 to the node 702 corresponding to the keyword604 in response to the node 702 not having an owner in block 520. In theexample illustrated in FIG. 7, the neighboring nodes 704 to node 702corresponding to the keyword 604 and flight operational procedureinclude the identifications 606: “Approach Chart” 606 a (neighboringnode 704 a), “Approach Clearance” 606 b (neighboring node 704 b),“Approach Checklist” 606 c (neighboring node 704 c), and “ApproachBriefing” 606 d (neighboring node 704 d). The identifications 606 of theneighboring nodes 704 are communicated to the pilot 103 by the chatbot102 in the conversation 602 as illustrated in the example conversationin FIG. 6A and block 526 of FIG. 5B.

In block 526, the method 500 or set of functions 130 performed by thedynamic conversational graph generator 128 includes generating aresponse including the identifications 606 of the neighboring nodes 704in response to the node 702 corresponding to the keyword 604 and flightoperational procedure having neighboring nodes 704 a-704 d. The responsegenerated by the dynamic conversational graph generator 128 includestokens each corresponding to the identifications 606 a-606 d of theneighboring nodes 704 a-704 d.

In block 528, the tokenizer 126 converts the tokens to text. In block530, the chatbot 102 constructs one or more sentences using the textfrom the tokenizer 126 as illustrated in FIG. 6A. In block 532, thetext-to-speech (TTS) converter 124 converts the text to speech. Thespeech is transmitted to the pilot 103 in block 532 by the speaker 112,or the text is presented on a display 106 or 108 in block 536, or bothas illustrated in FIG. 5B. In performance of the conversation with thepilot 103, which was indicated at block 514 as including the dynamicconversational graph generator detecting a keyword or keywords “ApproachPhase” in the conversation with the pilot using the tokens from thetokenizer, from which a node is identified corresponding to the keywordin the conversation that is determined to pertain to a particularaircraft system associated with the flight operational procedure, thedynamic conversational graph generator then generates a response thatincludes tokens corresponding to the identification that are convertedby the tokenizer to construct one or more sentences that are output ortransmitted to the pilot as speech and/or displayed on a display in thecockpit, such that the pilot can request an Approach checklist fordisplay (which can further be confirmed by voice or an entry by thepilot using a touchscreen).

In the example in FIGS. 5A-5B and FIGS. 6A-6B, the conversation 602 withthe pilot 103 continues similar to that previously described. In block538, the method 500 includes receiving a text response by the display,e.g., the cockpit display 106 or display of the portable electronicdevice 108 entered by the pilot 103 using touchscreen 114 or 116.Alternatively, or in addition, in block 540, the method 500 includesreceiving a speech response from the pilot 103 by the automatic speechrecognition (ASR) device 122. The response 608 in the example in FIG. 6Ais either a text response, speech response or both. In block 542, theASR device 122 converts the speech to text.

In block 544, the method 500 includes receiving the text response 608 bythe chatbot 102 from either the ASR device 122, display, or both. Inblock 546, the method 500 includes converting the text response 608 totokens by the tokenizer 126.

In block 548, the method 500 includes receiving the tokens by thedynamic conversational graph generator 128. In block 550, the method 500or set of functions 130 includes detecting another keyword 620 orkeywords corresponding to another flight operational procedure in theresponse 608 from the pilot 103 using the tokens. In the exampleconversation 602 in FIG. 6A, the other keyword 620 or keywords are“Approach Checklist” in the response 608 from the pilot 103.

In block 552, the method 500 or set of functions 130 performed by thedynamic conversational graph generator 128 further includes searchingthe neighboring nodes 704 a-704 d of the dynamic conversational graph700 to identify a certain neighboring node 704 c corresponding toanother keyword 620 or keywords during the conversation 602 with thepilot 103. In the example in FIG. 7, the keyword 620 “ApproachChecklist” corresponds to neighboring node 704 c.

In block 554, the method 500 or set of functions 130 further includesdetermining if the certain neighboring node 704 c corresponding to theflight operational procedure “Approach Checklist” has an owner oraircraft system 136 for performing the flight operational procedure. Inthe example in FIG. 7, the neighboring node 704 c has the owner node 706d “Electronic Checklist” which corresponds to the electronic checklist136 c performed by the display system in FIGS. 1 and 2.

In block 556, the method 500 or set of functions 130 includeshanding-off (block 558) communications to the system directedconversation module 134 in response to the certain neighboring node 704c having an associated owner node 706 d. Alternatively, the method 500advances to block 560 in response to the certain neighboring node 704not having an owner or aircraft system 136 for performing the flightoperational procedure. In block 560, the conversation ends or continuesin response to the pilot 103 continuing the conversation 602 by speechbeing received by the ASR device 122 and/or text being received by adisplay, e.g., cockpit display 106 or display of a portable electronicdevice 108.

FIG. 5C is an example of continuing the conversation using a particularaircraft system 136 in accordance with an example of the presentdisclosure. In block 562, the method 500 includes receiving text by adisplay. In accordance with some examples, the text is received by thetouchscreen 114 of the cockpit display 106 or the touchscreen 116 of thedisplay of the portable electronic device 108. In addition, oralternatively to receiving text by the display, in block 564, the method500 includes receiving speech by the ASR device 122. In block 566, theASR device 122 converts the speech to text. In some examples, the method500 includes presenting text of the speech on the display.

In block 568, the method 500 includes receiving the text by the chatbot102. In block 570, the method 500 includes converting the text to tokensby the tokenizer 126. In block 572, the method 500 includes receivingthe tokens by the system directed conversation module 134 as illustratedin the example in FIG. 1. The tokens include information associated withthe flight operational procedure from the conversation with the pilot103. The system directed conversation module 134 is configured toidentify, using the tokens, a particular aircraft system 136 forperforming the flight operational procedure. In block 572,mnemonic/opcode and operand/formatted instructions related to the flightoperational procedure are fetched by the system directed conversationmodule 134 from the database 140 as illustrated in the example inFIG. 1. The mnemonic/opcode and operand/formatted instructions aretransmitted by the system directed conversation module 134 to thecommand encoder/decoder 142.

In block 574, the command encoder/decoder 142 is configured to receiveand execute formatted instructions related to the flight operationalprocedure from the system directed conversation module forcommunications with a particular aircraft system 136 of the plurality ofaircraft systems 136 a-136 n. The command encoder/decoder 142 is furtherconfigured to interpret the mnemonic/opcode and operand/formattedinstructions and communicate avionics data with the particular aircraftsystem 136 of the plurality of aircraft systems 136 a-136 n forperforming the flight operational procedure.

In block 576, the method 500 includes performing an operation by theparticular aircraft system 136 in response to the encoded information.Examples of operations performed by a particular aircraft system 136 andcommunication with the pilot 103 are illustrated in the conversation 602in the example in FIG. 6B. In the example in FIG. 6B, the particularaircraft system 136, e.g., a display system, includes presenting 612 achecklist on a display; verifying 614 landing lights are switched on bythe pilot 103 and presenting confirmation on the display; verifying 616an altimeter setting set by the pilot 103 and presenting the altimetersetting on the display; and reading 618 navigation frequencies of thenavigation radios set by the pilot 103.

In block 578, the method 500 includes generating a response includingany information or data by the particular aircraft system 136 forcommunication to the pilot 103. In block 580, the response istransmitted by the particular aircraft system 136 to the commandencoder/decoder 142.

In block 582, the command encoder/decoder 142 is configured to decodethe particular information from the particular aircraft system 136 intoa set of responses for communications with the system directedconversation module 134. In block 584, the command encoder/decoder 142generates one or more responses for themnemonics/opcode-operands/formatted instructions that are executed bythe particular aircraft system 136. The one or more responses aretransmitted to the system directed conversation module 134. In block586, the system directed conversation module 134 receives the responseor responses to the mnemonics/opcode-operand/formatted instructions andfetches one or more corresponding tokens from the database 140. Thesystem directed conversation module 134 transmits the one or more tokensto the tokenizer 126 as also illustrated in the example in FIG. 1 andFIG. 2. In block 588, converting the tokens to text is performed by thetokenizer 126. The tokenizer 126 transmits the text to the chatbot 102for communication with the pilot 103.

In block 590, the chatbot 102 constructs one or more sentences using thetokens received from the tokenizer 126. Examples of sentencesconstructed by the Chatbot 102 during the exemplary conversation 602with the pilot 103 are illustrated in FIG. 6B. The chatbot 102 transmitsthe one or more sentences to the TTS converter 124.

In block 591, converting the text in the sentences to speech isperformed by the TTS converter 124. In block 592, transmitting thespeech to the pilot 103 is performed by the TTS converter 124 using thespeaker 112. In some examples, as previously described, the speaker 112is mounted in an audio panel 104 in the flight deck 105, a headset wornby the pilot 103, or both. In block 593, the conversation 602 with thepilot 103 ends or the method 500 returns to block 564 to continue theconversation 602 and receive additional speech from the pilot 103.Referring also to FIG. 6B, FIG. 6B illustrates an example of theconversation 602 continuing between the pilot 103 and a particularaircraft system 136 using the chatbot 102, system directed conversationmodule 134 and command encoder/decoder 142.

In some example, in block 594 in FIG. 5C, the text or sentences from thechatbot 102 are also presented on a display, e.g., cockpit display 106,the display of the portable electronic device 108, or both. In block596, the conversation 602 ends or the method 500 returns to block 562for receiving additional text entered by the pilot 103 in the display.

FIG. 8 is a flow chart of an example of a method 800 of operation of adynamic widget/form generator 144 in accordance with an example of thepresent disclosure. In block 802, the method 800 includes receiving thetokens 149, 152 from the tokenizer 126, or a controller-pilot data linkcommunications (CPDLC)/Aircraft Communication Addressing and ReportingSystem (ACARS) text analyzer 150 that receives text 156. The method 800also includes converting text 156 to one or more forms, widgets or both.The text 156 is text tokens 152 or communication (COMM) tokens receivedfrom an Aircraft Communications Addressing and Reporting System (ACARS)and/or a Data Link/Controller-Pilot Data Link Communications (DL/CPDLC)text analyzer 150, or TTS tokens 149 received from a system directedconversation module 134 or dynamic conversational graph generator 128via a tokenizer 126. The token or tokens are converted to graphicalopcode/operand/formatted instructions by the dynamic widget/formgenerator 144 using a keyword/phrase to dynamic forms/widgets database146. Referring also to FIGS. 9A and 9B, FIGS. 9A and 9B are examples ofchatbot windows 902 a-902 d and a pilot interaction window 904 a-904 dgenerated by the dynamic widget/form generator 144 during a conversationin accordance with an example of the present disclosure. FIGS. 9A and 9Balso illustrate tables 906 a-906 d including keywords 908 a-908 d andcorresponding widget definition files 910 a-910 d. The tables 906 a-906d are stored in the keyword/phrase to dynamic forms/widgets database 146for use by the dynamic widget/form generator 144 to generate dynamicforms, widgets, or both as illustrated in the examples in chatbot widows902-902 d and pilot interaction windows 904 a-904 d.

In block 804, the method 800 includes creating a panel 901 andpositioning widgets 903 within the panel 901 for pilot interactionwindow 904 a-904 d. In block 806, the method 800 includes positioningthe panel 901 in pilot interaction window 904 a-904 d in alignment tothe chatbot response in the chatbot window 902 a-902 d. In block 808,the method 800 includes processing the graphics and transmitting thegraphics to the display computer 118 for presentation on the cockpitdisplay 106, and/or transmitting the graphics to the aircraft interfacedevice 120 for presentation on the portable electronic device 108.

In block 810, the method 800 includes receiving a response or input fromthe pilot 103. As previously described, the response or input is in theform of speech received by the system 100 from the pilot 103 and/or thepilot 103 interacting with a touchscreen 114 of the cockpit display 106or touchscreen 116 of the portable electronic device 108. In block 812,the method 800 returns to the chatbot 102 and ASR device 122 to receivefurther responses or inputs from the pilot 103.

FIG. 10 is a flow chart of an example of a method 1000 for generating ahistorical/trained conversation database 132 in accordance with anexample of the present disclosure. In block 1002, the method 1000includes receiving conversational text, e.g., text is received from apilot or other user. In block 1004, the method 1000 includes convertingthe text into tokens by the tokenizer.

In block 1006, the method 1000 includes creating a bag of words.Creating a bag of words is a process of representing text data whenmodeling text with a machine learning algorithm. The bag of wordsincludes a vocabulary of known words, e.g., approach, phase, weather,destination, airport, radio, frequency, tuning, etc.

In block 1008, the method 1000 includes performing featurecharacterization using document sources 1010. Each word or phrase isreferred to as a gram. Creating a vocabulary of two-words (n=2) pairsis, in turn, referred to as a bigram model, e.g., approach briefing,flight phase, approach checklist, destination airport, weatherdestination, etc. Examples of document sources 1010 for performingfeature characterization include but are not limited to an aircraftsystem/subsystem list 1011, an airport directory 1012, an airplaneflight manual (AFM) 1014, a quick reference handbook (QRH) 1016,dispatch files 1018, different checklists 1020, and aeronautical charts1022. Examples of the aircraft system/subsystem list 1011 include arenot limited to displays, a flight control system (FCS), a flightmanagement system (FMS), maintenance system, etc.

In block 1024, the method 1000 includes performing word-to-vector(Word2Vec) conversions. Word associations are made from a large corpusof words. Word2Vec conversion represents each distinct word with aparticular list of numbers called a vector. In Word2Vec conversion, eachword or phrase originating from document sources 1010 and theinter-relationship between the words or phrases characterized in block1008 are numerically represented as an array of numbers.

In block 1026, the method 1000 includes performing topic modeling. Topicmodeling facilitates in the discovery of semantic structures in a textbody by comparing the distance between the vectors in the word vectorspace to identify the topics. Topic modeling also includes extractingmain topics from a dataset. Examples of semantic structures include butare not limited to weather, navigation, aircraft state, standardoperating procedures (SOPs), etc.

In block 1028, the method 1000 includes clustering or grouping words orphrases into different clusters 1030-1034. Words or phrases that arerelated are grouped into the same cluster. Each clusters is thenassociated to a topic, e.g., similarity measurements are used to clusterrelated words, phrases or documents together. Examples of clustersinclude but are not limited to AFM cluster 1030, QRH cluster 1032,checklists cluster 1034, etc. For example, if conversational text is“Hey bot, can you get me the approach checklist.” There is a highprobability, e.g., about 80% chance to hit the checklists cluster 1034.

In block 1036, the method 1000 includes mapping to an avionicapplication owner in response to a keyword or keywords in theconversation text. In the example where the keywords are “approachchecklist,” the conversation is mapped to the display system which isthe avionic application owner for displaying the approach checklist.

In block 1038, the method 1000 includes performing graph generationwhich builds the relationship with data elements within the cluster,between the clusters, and avionics application owners to necessary dataelements in the form of a graph represented by a mesh comprising nodesand edges. This graph is stored and represented as a historical/trainedconversation database 132, which is field loadable.

FIG. 11 is a flow chart of an example of a method 1100 for flight deckcommunications in accordance with an example of the present disclosure.In some examples, the method 1100 is embodied in and performed by thesystem 100 in FIGS. 1 and 2. In some examples, the set of functions 130performed by the dynamic conversational graph generator 128, the set offunctions 138 performed by the system directed conversation module 134,the set of functions 148 performed by the dynamic widget/form generator144, and functions performed by other components of the system 100 asdescribed herein are also included in the method 1100.

In block 1102, the method 1100 includes performing, by a chatbot, aconversation with a pilot. The conversation includes speechcommunications, visual communications using a display, or both.

In block 1104, the method 1100 includes determining, by a dynamicconversational graph generator, a flight operational procedure from theconversation with the pilot. In block 1106, the method 1100 includesproviding, by the dynamic conversational graph generator, informationassociated with the flight operational procedure to the chatbot forcommunicating to the pilot. In block 1108, the method 1100 includesresponding, by the dynamic conversational graph generator, to anyrequests received by the chatbot during the conversation with the pilot.

In block 1110, the method 1100 further includes handing-offcommunications to a system directed conversation module by the dynamicconversational graph generator in response to the flight operationalprocedure being associated with a particular aircraft system or avionicsapplication owner. In block 1112, the method 1100 includes directing theconversation with the pilot to a particular aircraft system, e.g., oneof aircraft systems 136 a-136 n in FIGS. 1 and 2.

In block 1114, the method 1100 includes providing, by the systemdirected conversation module or the particular aircraft system, theinformation associated with the flight operational procedure to thechatbot for communication to the pilot.

In block 1116, the method 1100 includes generating a particular form,widget or both associated with the flight operational procedure forpresentation in a window on a display. The particular form, widget orboth are configured for interaction with the pilot. Pilot interactionwith the particular form, widget or both includes at least one ofinteraction by conversing with the chatbot or interaction by the pilottouching a feature of the particular form, widget, or both in a displayor touchscreen.

In block 1118, the method 1100 includes presenting the form, widget orboth in a window on the display for interaction with the pilot. Inaccordance with the example in FIGS. 1 and 2, the display includes thecockpit display 106, display of the portable electronic device 108, orboth. The pilot interaction includes the pilot touching a touchscreen114 of a cockpit display 106, the touchscreen 116 of a portableelectronic device 108, or both. In some examples, the pilot interactionalso includes speech communication with the form, widget or both usingthe audio panel 104, microphone 110, speaker 112, ASR device 122, TTSconverter 124, chatbot 102 and tokenizer 126 in FIGS. 1 and 2.

FIG. 12 is an example of a system 1200 for flight deck communications inaccordance with an example of the present disclosure. In some examples,the system 100 in FIGS. 1 and 2 is embodied in one or more systemssimilar to or the same as the system 1200. In some examples, at leastsome of the components of the system 100 in FIGS. 1 and 2, e.g., thechatbot 102, the tokenizer 126, the dynamic conversational graphgenerator 128, the system directed conversation module 134, the commandencoder/decoder 142, one or more of the aircraft systems 136, thedynamic widget/form generator 144, the DL/CPDLC/ACARS text analyzer 150,the aircraft interface device 120, and the display computer 118 areembodied in one or more systems similar to or the same as the system1200. In some examples, at least some of the methods 300, 400, 500, 800,1000, and 1100 are embodied in and performed by one or more systemssimilar to or the same as the system 1200.

The system 1200 includes a processing circuit 1202 and a memory 1204associated with the processing circuit 1202. The memory 1204 includescomputer-readable program instructions 1206 that, when executed by theprocessing circuit 1202 causes the processing circuit 1202 to perform aset of functions 1208. In some examples, the set of functions 1208includes the set of functions 130 performable by the dynamicconversational graph generator 128, the set of functions 138 performableby the system directed conversation module 134, and/or the set offunctions 148 performable by the dynamic widget/form generator 144. Thesets of functions 130, 138 and 148 are embodied on one or more systemsthat are similar to or the same as the system 1200. In some examples,the set of functions 1208 includes at least some of the methods 300,400, 500, 800, 1000 and 1100 that are embodied on and performed by oneor more systems that are similar to or the same as the system 1200.

In some examples, the system 1200 also includes one or more input/outputdevices 1210. The input/output devices 1210 include separate inputdevices, output device or combination input and output devices. Examplesof the input/output devices 1210 include but are not limited to one ormore display devices, a touchscreen, microphone, speaker, keyboard orkeypad, pointing device, and a device configured to read or accesscomputer-readable program instructions on a computer program product1212 similar to that described herein. Any of the methods 300, 400, 500,800, 1000 and/or 1100 can be embodied on the computer program product1212, read by the input/output device 1210 and stored in the memory1204.

Further, the disclosure comprises examples according to the followingclauses:

Clause 1. An interface system for flight deck communications, theinterface system comprising:

-   -   a chatbot configured to perform a conversation with a pilot,        wherein the conversation comprises speech communications, visual        communications using a display, or both; and    -   a dynamic conversational graph generator configured to perform a        set of functions comprising:    -   determining a flight operational procedure from the conversation        with the pilot;    -   providing information associated with the flight operational        procedure to the chatbot for communicating to the pilot; and    -   responding to any requests received from the pilot by the        chatbot during the conversation with the pilot.

Clause 2. The interface system of clause 1, further comprising atokenizer configured to:

convert text received from the chatbot to tokens transmitted by thetokenizer; and

convert tokens received by the tokenizer to text that is transmitted tothe chatbot to perform the conversation with the pilot.

Clause 3. The interface system of any of clauses 1 or 2, wherein the setof functions performed by the dynamic conversational graph generatorfurther comprises:

detecting a keyword in the conversation with the pilot using the tokensfrom the tokenizer, wherein the keyword identifies a particular flightoperational procedure;

searching a plurality of nodes of a dynamic conversational graph toidentify a node corresponding to the keyword in the conversation withthe pilot, wherein each node corresponds to a different flightoperational procedure;

handing-off communications to a system directed conversation module inresponse to the node corresponding to the keyword having an owner,wherein the owner is a particular aircraft system associated with theflight operational procedure; and

determining an identification of any neighboring nodes in the dynamicconversational graph to the node corresponding to the keyword inresponse to the node not having an owner, wherein the identification ofany neighboring nodes are communicated to the pilot by the chatbot inthe conversation.

Clause 4. The interface system of any of clauses 1-2 or 3, wherein theset of functions performed by the dynamic conversational graph generatorfurther comprises:

searching neighboring nodes of the dynamic conversational graph toidentify a certain neighboring node corresponding to another keywordduring the conversation with the pilot; and

handing-off communications to the system directed conversation module inresponse to the certain neighboring node having an associated owner.

Clause 5. The interface system of any of clauses 1-3 or 4, furthercomprising a system directed conversation module configured to providecertain tokens comprising particular information associated with theflight operational procedure to the tokenizer in response to the flightoperational procedure being associated with a particular aircraft systemof a plurality of aircraft systems, wherein the dynamic conversationalgraph generator is configured to handoff communications to the systemdirected conversation module in response to the flight operationalprocedure being associated with the particular aircraft system.

Clause 6. The interface system of any of clauses 1-4 or 6, wherein thesystem directed conversation module is configured to perform a set offunctions comprising:

receiving tokens from the tokenizer, the tokens comprising informationassociated with the flight operational procedure;

querying the database for the flight operational procedure;

determining the particular aircraft system of the plurality of aircraftsystems for performing the flight operational procedure; and

communicating information related to the flight operational procedurewith the pilot through the tokenizer and the chatbot.

Clause 7. The interface system of any of clauses 1-5 or 6, furthercomprising a command encoder/decoder configured to:

receive and execute formatted instructions related to the flightoperational procedure from the system directed conversation module forcommunications with the particular aircraft system of the plurality ofaircraft systems; and

-   -   decode the particular information from the particular aircraft        system into a set of responses for communications with the        system directed conversation module.

Clause 8. The interface system of any of clauses 1-7 or 7, furthercomprising a dynamic widget/form generator configured to perform a setof functions comprising:

receiving the tokens from the tokenizer, or a controller-pilot data linkcommunications (CPDLC)/Aircraft Communication Addressing and ReportingSystem (ACARS) text analyzer that receives text; and

generating a particular form, widget or both in response to the tokens.

Clause 9. The interface system of any of clauses 1-7 or 8, furthercomprising a system directed conversation module configured to directthe conversation with the pilot to a particular aircraft systemassociated with the flight operational procedure, wherein the dynamicconversational graph generator is configured to handoff communicationsto the system directed conversation module in response to the flightoperational procedure being associated with the particular aircraftsystem of a plurality of aircraft systems.

Clause 10. The interface system of any of clauses 1-8 or 9, furthercomprising a dynamic widget/form generator configured to generate aparticular form, widget or both associated with the flight operationalprocedure for presentation in a window on a display, wherein theparticular form, widget or both are configured for interaction with thepilot.

Clause 11. The interface system of any of clauses 1-9 or 10, wherein avisual positioning or alignment of the particular form, widget or bothassociated with the flight operational procedure is correlated to acorresponding visual chatbot conversational text.

Clause 12. The interface system of any of clauses 1-10 or 11, whereinpilot interaction with the particular form, widget or both comprises atleast one of interaction by conversing with the chatbot or interactionby the pilot touching a feature of the particular form, widget, or both.

Clause 13. The interface system of any of clauses 1-11 or 12, furthercomprising:

an automatic speech recognition device configured to receive speech fromthe pilot and to convert the speech to text for transmission to thechatbot; and

a text-to-speech converter configured to receive text from the chatbotand to convert the text to speech for transmission to the pilot by aspeaker, wherein the speaker is in a flight deck or a headset of thepilot.

Clause 14. The interface system of any of clauses 1-12 or 13, whereinthe chatbot is configured to perform the conversation with the pilotusing at least one of an audio panel in a flight deck, a cockpit displayin the flight deck, or a portable electronic device.

Clause 15. A method for flight deck communications, comprising:

performing, by a chatbot, a conversation with a pilot, wherein theconversation comprises speech communications, visual communicationsusing a display, or both;

determining, by a dynamic conversational graph generator, a flightoperational procedure from the conversation with the pilot;

providing, by the dynamic conversational graph generator, informationassociated with the flight operational procedure to the chatbot forcommunicating to the pilot; and

responding, by the dynamic conversational graph generator, to anyrequests from the pilot received by the chatbot during the conversationwith the pilot.

Clause 16. The method of clause 15 and any of the preceding clauses,further comprising:

handing-off communications to a system directed conversation module bythe dynamic conversational graph generator in response to the flightoperational procedure being associated with a particular aircraftsystem; and

providing, by the system directed conversation module, the informationassociated with the flight operational procedure to the chatbot forcommunication to the pilot.

Clause 17. The method of clause 15 or 16, further comprising:

detecting a keyword in the conversation with the pilot using tokens froma tokenizer, wherein the keyword identifies a particular flightoperational procedure;

searching a plurality of nodes of a dynamic conversational graph toidentify a node corresponding to the keyword in the conversation withthe pilot, wherein each node corresponds to a different flightoperational procedure;

handing-off communications to a system directed conversation module inresponse to the node corresponding to the keyword having an owner,wherein the owner is a particular aircraft system associated with theflight operational procedure; and

determining an identification of any neighboring nodes in the dynamicconversational graph to the node corresponding to the keyword inresponse to the node not having an owner, wherein the identification ofany neighboring nodes are communicated to the pilot by the chatbot inthe conversation.

Clause 18. The method of any of clauses 15-16 or 17, further comprising:

converting, by a tokenizer, text received from the chatbot to tokens;and

converting tokens received by the tokenizer to text that is transmittedto the chatbot to perform the conversation with the pilot.

Clause 19. The method of any of clauses 15-17 or 18, further comprising:

providing, by a system directed conversation module, tokens comprisingthe information associated with the flight operational procedure to thetokenizer in response to the flight operational procedure beingassociated with a particular aircraft system, wherein the dynamicconversational graph generator is configured to handoff communicationsto the system directed conversation module in response to the flightoperational procedure being associated with the particular aircraftsystem.

Clause 20. The method of any of clauses 15-18 or 19, further comprisinggenerating a particular form, widget or both associated with the flightoperational procedure for presentation in a window on a display, whereinthe particular form, widget or both are configured for interaction withthe pilot, wherein pilot interaction with the particular form, widget orboth comprises at least one of interaction by conversing with thechatbot or interaction by the pilot touching a feature of the particularform, widget, or both.

The flowchart and block diagrams in the Figures illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods, and computer program products according to variousexamples of the present disclosure. In this regard, each block in theflowchart or block diagrams may represent a module, segment, or portionof instructions, which comprises one or more executable instructions forimplementing the specified logical function(s). In some alternativeimplementations, the functions noted in the block may occur out of theorder noted in the figures. For example, two blocks shown in successionmay, in fact, be executed substantially concurrently, or the blocks maysometimes be executed in the reverse order, depending upon thefunctionality involved. It will also be noted that each block of theblock diagrams and/or flowchart illustration, and combinations of blocksin the block diagrams and/or flowchart illustration, can be implementedby special purpose hardware-based systems that perform the specifiedfunctions or acts or carry out combinations of special purpose hardwareand computer instructions.

The terminology used herein is for the purpose of describing particularexamples only and is not intended to be limiting of examples of thedisclosure. As used herein, the singular forms “a”, “an” and “the” areintended to include the plural forms as well, unless the context clearlyindicates otherwise. It will be further understood that the terms“include,” “includes,” “comprises” and/or “comprising,” when used inthis specification, specify the presence of stated features, integers,steps, operations, elements, and/or components, but do not preclude thepresence or addition of one or more other features, integers, steps,operations, elements, components, and/or groups thereof.

The corresponding structures, materials, acts, and equivalents of allmeans or step plus function elements in the claims below are intended toinclude any structure, material, or act for performing the function incombination with other claimed elements as specifically claimed. Thedescription of the present examples has been presented for purposes ofillustration and description, but is not intended to be exhaustive orlimited to examples in the form disclosed. Many modifications andvariations will be apparent to those of ordinary skill in the artwithout departing from the scope and spirit of examples.

Although specific examples have been illustrated and described herein,those of ordinary skill in the art appreciate that any arrangement whichis calculated to achieve the same purpose may be substituted for thespecific examples shown and that the examples have other applications inother environments. This application is intended to cover anyadaptations or variations. The following claims are in no way intendedto limit the scope of examples of the disclosure to the specificexamples described herein.

What is claimed is:
 1. An interface system for flight deck communications, the interface system comprising: a chatbot configured to perform a conversation with a pilot, wherein the conversation comprises speech communications, visual communications using a display, or both; and a dynamic conversational graph generator configured to perform a set of functions comprising: determining a flight operational procedure from the conversation with the pilot; providing information associated with the flight operational procedure to the chatbot for communicating to the pilot; and responding to any requests received from the pilot by the chatbot during the conversation with the pilot.
 2. The interface system of claim 1, further comprising a tokenizer configured to: convert text received from the chatbot to tokens transmitted by the tokenizer; and convert tokens received by the tokenizer to text that is transmitted to the chatbot to perform the conversation with the pilot.
 3. The interface system of claim 2, wherein the set of functions performed by the dynamic conversational graph generator further comprises: detecting a keyword in the conversation with the pilot using the tokens from the tokenizer, wherein the keyword identifies a particular flight operational procedure; searching a plurality of nodes of a dynamic conversational graph to identify a node corresponding to the keyword in the conversation with the pilot, wherein each node corresponds to a different flight operational procedure; handing-off communications to a system directed conversation module in response to the node corresponding to the keyword having an owner, wherein the owner is a particular aircraft system associated with the flight operational procedure; and determining an identification of any neighboring nodes in the dynamic conversational graph to the node corresponding to the keyword in response to the node not having an owner, wherein the identification of any neighboring nodes are communicated to the pilot by the chatbot in the conversation.
 4. The interface system of claim 3, wherein the set of functions performed by the dynamic conversational graph generator further comprises: searching neighboring nodes of the dynamic conversational graph to identify a certain neighboring node corresponding to another keyword during the conversation with the pilot; and handing-off communications to the system directed conversation module in response to the certain neighboring node having an associated owner.
 5. The interface system of claim 2, further comprising a system directed conversation module configured to provide certain tokens comprising particular information associated with the flight operational procedure to the tokenizer in response to the flight operational procedure being associated with a particular aircraft system of a plurality of aircraft systems, wherein the dynamic conversational graph generator is configured to handoff communications to the system directed conversation module in response to the flight operational procedure being associated with the particular aircraft system.
 6. The interface system of claim 5, wherein the system directed conversation module is configured to perform a set of functions comprising: receiving tokens from the tokenizer, the tokens comprising information associated with the flight operational procedure; querying a database for the flight operational procedure; determining the particular aircraft system of the plurality of aircraft systems for performing the flight operational procedure; and communicating information related to the flight operational procedure with the pilot through the tokenizer and the chatbot.
 7. The interface system of claim 5, further comprising a command encoder/decoder configured to: receive and execute formatted instructions related to the flight operational procedure from the system directed conversation module for communications with the particular aircraft system of the plurality of aircraft systems; and decode the particular information from the particular aircraft system into a set of responses for communications with the system directed conversation module.
 8. The interface system of claim 2, further comprising a dynamic widget/form generator configured to perform a set of functions comprising: receiving the tokens from the tokenizer, or a controller-pilot data link communications (CPDLC)/Aircraft Communication Addressing and Reporting System (ACARS) text analyzer that receives text; and generating a particular form, widget or both in response to the tokens.
 9. The interface system of claim 1, further comprising a system directed conversation module configured to direct the conversation with the pilot to a particular aircraft system associated with the flight operational procedure, wherein the dynamic conversational graph generator is configured to handoff communications to the system directed conversation module in response to the flight operational procedure being associated with the particular aircraft system of a plurality of aircraft systems.
 10. The interface system of claim 1, further comprising a dynamic widget/form generator configured to generate a particular form, widget or both associated with the flight operational procedure for presentation in a window on a display, wherein the particular form, widget or both are configured for interaction with the pilot.
 11. The interface system of claim 10, wherein a visual positioning or alignment of the particular form, widget or both associated with the flight operational procedure is correlated to a corresponding visual chatbot conversational text.
 12. The interface system of claim 10, wherein pilot interaction with the particular form, widget or both comprises at least one of interaction by conversing with the chatbot or interaction by the pilot touching a feature of the particular form, widget, or both.
 13. The interface system of claim 1, further comprising: an automatic speech recognition device configured to receive speech from the pilot and to convert the speech to text for transmission to the chatbot; and a text-to-speech converter configured to receive text from the chatbot and to convert the text to speech for transmission to the pilot by a speaker, wherein the speaker is in a flight deck or a headset of the pilot.
 14. The interface system of claim 1, wherein the chatbot is configured to perform the conversation with the pilot using at least one of an audio panel in a flight deck, a cockpit display in the flight deck, or a portable electronic device.
 15. A method for flight deck communications, comprising: performing, by a chatbot, a conversation with a pilot, wherein the conversation comprises speech communications, visual communications using a display, or both; determining, by a dynamic conversational graph generator, a flight operational procedure from the conversation with the pilot; providing, by the dynamic conversational graph generator, information associated with the flight operational procedure to the chatbot for communicating to the pilot; and responding, by the dynamic conversational graph generator, to any requests from the pilot received by the chatbot during the conversation with the pilot.
 16. The method of claim 15, further comprising: handing-off communications to a system directed conversation module by the dynamic conversational graph generator in response to the flight operational procedure being associated with a particular aircraft system; and providing, by the system directed conversation module, the information associated with the flight operational procedure to the chatbot for communication to the pilot.
 17. The method of claim 15, further comprising: detecting a keyword in the conversation with the pilot using tokens from a tokenizer, wherein the keyword identifies a particular flight operational procedure; searching a plurality of nodes of a dynamic conversational graph to identify a node corresponding to the keyword in the conversation with the pilot, wherein each node corresponds to a different flight operational procedure; handing-off communications to a system directed conversation module in response to the node corresponding to the keyword having an owner, wherein the owner is a particular aircraft system associated with the flight operational procedure; and determining an identification of any neighboring nodes in the dynamic conversational graph to the node corresponding to the keyword in response to the node not having an owner, wherein the identification of any neighboring nodes are communicated to the pilot by the chatbot in the conversation.
 18. The method of claim 15, further comprising: converting, by a tokenizer, text received from the chatbot to tokens; and converting tokens received by the tokenizer to text that is transmitted to the chatbot to perform the conversation with the pilot.
 19. The method of claim 18, further comprising: providing, by a system directed conversation module, tokens comprising the information associated with the flight operational procedure to the tokenizer in response to the flight operational procedure being associated with a particular aircraft system, wherein the dynamic conversational graph generator is configured to handoff communications to the system directed conversation module in response to the flight operational procedure being associated with the particular aircraft system.
 20. The method of claim 15, further comprising generating a particular form, widget or both associated with the flight operational procedure for presentation in a window on a display, wherein the particular form, widget or both are configured for interaction with the pilot, wherein pilot interaction with the particular form, widget or both comprises at least one of interaction by conversing with the chatbot or interaction by the pilot touching a feature of the particular form, widget, or both. 